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PREFACE * . - . 

t • - * 

This is. the sixth in a series of cooperative research efforts that began 
* in^W78 between the^Naval Training Equipment Centei'^ cind the Air Force Human 
ResoVces Uabor;atory» The present study was carried out at-Lowry Air Force 
8ase-^olorado/ during the summer "of 1983. Unlike previous, research performed 
und«^ the Cooperative Study iSeries which focused on flight training, t^ie, 
€ present study examines issues related to the use of automated job performance 
aids, (JPA§) for maintenance. 

Both the^Naval Training Equipment Center and the Air Force ftuman 
Resources Laboratory are engaged in research aimed at developing automated 
JPAs for maintenance. Although the two research programs differ in many 
respects, there a;-a, nonetheless, several shared res-earch issues whicf? must be 
resolved before the systems can be fielded. ^Jhe issdes addressed, in this 
study concern the presentation of technical information via electronic 
delivery media. The study examines how changes in display screen size and 

^level of resolution impact maintenapce^ask performance when technical 

'information is presented on a CRT ♦ 

« 

Both commands shared in performing this 'research. ^^The Naval Training 
Equipment Center developed the research design, prepared tlie expeirimental 
materials in a hardcopy format, analyzed the data, and prepared the technical 
report. The Air Force Human Resources Laboratory provided the computer . 
hardware, developed the software, provided the testbed" equipment, converted 
the hardcopy experimental materials to an electronic format,, coordinated an.d 
carried out the data collection, provided financial support,, and reviewed the 
technical report. ^ .. .. 

Several individuals made ^significant contributions to ±hls research. 
Mr. Donald Thomas of the Air Force Human Resources Laboratory (Wright 
Patterson Air Force Base), 1st Lt Bradley J. Poulliot of the Air Force Human 
-Resources Laboratory (Lowry Air Force Base), and" Mr* Erich Pearsipn of the 
Denver Research institute provided the technical expertise required to 
accomplish the research. ^ - 

Thirty-six enlisted Air Force students from the 3453rd Student Squadron 
at the Ldwry Technical Training Center served as subjects in this experiment. 
They are to be commended for their p'articipatlon .and cooperation during the . 
study. The students were made available through the efforts of 
SSgt David Mann, the Student Training Advisor, and SSgt Kevin Robinson, bot\u 
of the 3406th Student Squadron at Lowry Technical Training Center. Their 
assistance is greatly appreciated. . 

Also, a special thank-yoy. goes tq those individuals who reviewed early 
drafts of this report and provided valuable comments. J\\ey include Dr. 
Eduardo Salas, Dr. James Dr>skell, Dr.' Richard Reynolds, Dr. Arthur Blaiwes, 
Dr. Dee 'Andrews, Dr. Charles Beagles, and Mr. Dennis WeTler, of the Naval 
Training Equipment Center's Human Factors Division. Finally, my sincere 
appreciation goes to Ms.. Wanda ATlard for her many hours of work involved in 
the preparation' and productioji of this report. , 
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introduction: 
' background ' ' ' . ■ 
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The Naval iVe^ining Equipment Center (NAVTRAEQUIPCEN) and the Air 'Force 
Human Resources laboratory (AFHRL) are devei-oping automated job performance ^ 
aids (jPAs) for maint^ilanr.e. The purpose of the NAVTRAEQUIPCEN program fs' to 
develop f ^rot^type Per-sonal Electronic Aid-for ^intsnance (PEAM) which is a 
small, 1-ightw^ight, pcrtable JPA that can be transported by maintenance 
personnel to the job '^ite. , The system is intended to be used for the , 
presentation of technic&l^Jnformation in support of organizational (0) level \ 
maintenance of Navy weapon systems. The AFHf^l program Automated Technical , 
Data Requirements Design Study) is Jirected* toward the development of a \ 
prototype /technical data presentation system for intermediate (I) lev^l \ 

maintenance of Air force weapon systems with subsequent follow-on applicati^ons > 

for 0 level maintenance*. . ' > ' - , 1 " 

- • - - ;. : 

The two programs differ in terms of the type and scope of "the technical \. - 
data^ to be- presented, the environmental conditions under which the systems;*- 1 / 
must operate, <ind the cons^traints (e.g., size, memory, durability) placed on" 
the systems. The programs overiapi however, in that both involve the ; • 
presentation of technical information via an electronic display medium. 

The use of electronic delivery media for job performance aiding requires . \ 

a careful^ consideration of the design' variables associated with the | 

presentation of technical information* Poor design, inaccurately specified , ' 

visual .display parameters, and/or omission of critical design features can ' ' 
hinder legibility and' may result in a JPil device which is not used or whicti 
may prove to be ineffective in providing troub^leshooting assistance. 

Many design features can potentially impact the legitimty of technical 
information presented on electronic delivery , media. Consequently, it becomes 
critical to derive research-based standards to "dejbermine the delivery media ' 
requirements, and ultimately jpA device design. Past research has focused 
primarily on character attributes (alphanumerics) and has proMtided design 
guidance on variables such as optimum symbel size, character fontV, luminance 
'levels, contrast/ratios, etc. (See Appendix A for a' summary oflj this past 
research and Meister (1984) for a complete review). However, ther^ has been a 
lack of research on the legibility of graphic displays, partidilarly line 
drawings, presented via electronic delivery media (Swezey ahd Davis, 1983).. 
Since automated technical data will make- extensive use of grapi^ics (e.g., PC 
boards, schematics, locator diagrams, IPBs), the legibility prthe stimulus 
itiaterials must be optimized in order to promotj^ efficient and effective 
maintenance task performance-? - • 
t • 
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PRESENT STUDY : • - • ' ^ 

The present study, the first in a more protracted research program on tht; 
legibility of graphics in JPAs, was 'designed to assess the effect of alternate 
dispVayXCRT) s^creen sizes and resolution levels on user ability to identify 
.and locate PC Board test point^. Screen* size waS, examined because of its 
dirept impact on device portability, a primary design considerajtion. Smaller 
displays not only promote portability, but are also less expensive than larger 
ones* However, the impact of small screen graphics on legibility is ^ unclear, 
the presentation of high,, density (complex) graphics on sma,ll screen sizes 
tends to produce a "cluttered" display which may interfere with the e^bility to 
accurately percaive and d^iscrirfiinate between components of the gra^hifc (Swezey 
and Davis, 1983). Therefore, it is' important to* determine the"^ effect of 
screen Size on legibility of graphics. . ^ ' * 

The second variable examined was display resolution. Despite GouVd's 
(1968), recommendation of 5P scan lines (i,e., picture elements or I'pt^els") 
per inch for graphics', high resolution is often assumed tj3 be^ wanranted 
because of the greater display clarity and the intuipve belief .^hat , higher* 
resolution {-automat i call y) improves legibility. Becati^'e of the lower costs 
associated with low resolutibn ^graphics product i^on and 'the^ impact of 
resolution on display monijtor requirements, it is important to determine if 
low resolution graphics impact legibility. It is also important to determine 
if higher resolution can provide -enough clarity to "compensate" for small 
screen clutter when complex graphics, are displayed.^ ^. ^ / ■ 

The present study examined three CR-T screen sizes {^"x5",^ 9"x9", and 
12"icl2")^ and' four levels if resolution (35, 70; 140, and 280 dots (i.e., 
pixels) per inch) and assessed the impact of changes in these var*iables on 
locator task performance. The three screen sizes and^the four resolution 
levels were selected because of their representativeness of the range of 
display screens commercially available. The task inyol^ved locating test 
points (i.e., •components" and solder coHnections) on two actuS-1 PC boards (one 
component side and one pin,s4de) based on test paints identified in a graphic* 
display. It was hypothesizec|j that perfprmanG^^ woul-d not be differential ly 
affected, by scree'n^MZft or by resolution leve^ for either the Component side 
or pin side PO board pTsplays. 
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SAMPLE r . • • . . ■ . . ' . ( 

Thirty-.s.ix Air Force maintenance training pipeline students '(35 liftale and 
1 female) served as participants iii the study. All students '^ei'e enrolled in 
the^recision ^feast^r,ement Electronivcs Specia>4ty course (Number 3ADR324XD) at 
the Lowry TechnicaT Training Center, Lowry Ajr Force Base',* CO. The studepts 
ranged in age from 18 to 26 years with a mean age of 20.6 years. .Length^f 
time in Air force service^ for the students ran.gecj from 7 weeks to 10 months 
with a mean length' of time in service of 4'.1 months. .Seventeen of the 
students wore gUsses (or contact lenses), 19 did not. Visual acuity was not 
assessed. All students were first term enTisteeS[ attending their first Air 
Force technical school. Of the 36 students, '^tjirle indicated that they had 
received some high siphool electronics training and one indi;cated that he 
attended a five-month communications electronics course at a private technical 
school. For the r^efniining students, the Precision Measurement ElectrOnics- 
Speciality course constituted their oifly electronics training.., 

APP7\RATUS / ' . , ♦ 

•The Megatek 7210 high resolution vector graphics system driven by the 
Digital Equipinent Corporation (DEC) POP 11/34 mini-computer (M^gatek/PDP) 'was 
the system used for presentation of the ^stimulus materials to' the students.. 
The> Megatek/PDP graphics system was a configuration established specifically 
for this study and consisted of the following: (I) a .Megatek vector-type 
graphics display, (2) a Megatek graphics processor and associated- peripherals, 
(3) a Oigi-Pad 5 graphics digitizer, (4) a POP 11/34 processor and associated 
peripherals, and (5) a DEC VTIOO terminal for keyboard input. \ 

^ The Control Data Corporation (CilC.) CYBER* 73-16, mainframe computer was 
also used in subport of this study. In order to take advantage of the* 
graphics deyelopmemt tools available on the CYBER 73-16 system, an emulation, 
program written in FORTRAN ^on the POP 11/34 was '-developed to interface the 
Megatek/PDP graphics system with the CYBER 73-16. The emu^lation program was 
designed to make tthe Megatek/PDP graphics system function as a Chromatics CG 
Series graphics terminal for which the CYBER 73-16 has support facilitiSSt 
The emulation program wa$ also designed to simulate the three display screen 
.sizes and the four^levels of resolution. *^ ^ 

Two actual PC boards (the transbitter^an^the" synthesizer boards) from* 
the AN/ARC-164 UHE Radio were also used i^n ttle study. The sizes of the actual 
PC boards and the graphic? PC toards are presented in Table 1. 
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TABLE 1 - PC BOARD DIMENSIONS IN INCHES* . 





Transmitter Board 


S-yntKesizer Board 


'Actual Board 
5x5"' Graphic \ 


4.9'4x4.69 
•' 4.75x4.38 -- , 


4.50x4.00 J 
4.31x3»7^ 


9x9" Graphic '.^ 


; .. 8.63x8^^00 




* 

'12x12" -Graphic 


.11.63x10.75 ^ 


,10.50x9.13; 



^Subject to a measuremenl; error of +/- 0,06 inches ; * \ 
PROCEDURE . ^ . ^ 

t • • ' 

. T¥e t^^n^mitter and synthesizer PC boards of the AN/ARCn64 .^UHF Radio 
were 'selected for study because of their representativeness of the types of PC 
boards typically encountered *in maintenance tasks. The .component (piece-part) 
side /Of the transmitter boarcUFiqure- 1) "and the -pin' (solder run)^side of the 
synthisizer board (Figure 2) were used in this, study. » <- 

" -.1 . • 

\ 'line drawings (-paper and pencil) were genferate'd for each of the two PC 
boards. The* drav/ings^ contained all of thej detail of the.actu^ PC boards.*, 
Graphic line drawings of the two boards -were t,hen digitized manually usins tne 
D'igi-Pad % graphics' digitizer -for gr^iphic ;dTspl ay m the Megatej^- 7210 high 
resolution monitor. The .result was. a graph ii;,idi splay of the component. side or 
the trahsmi.tter" PC board and a graphic [display of the pin si da of the 
"synthesizer Pi board.. ' ■ 1 '• ).*' •', 

' Forty conportents on the transmitter board. and 20 pin% on the synthesizer 
•board were ' selected* as test points for usS in the locator task. The -40 
components on Ihe transmitter board*. were divided into 10. groups with each 
qroup composed of four similar components matched on size, . shape, and 
proxiinitji to ke)^ features (i.e., each of the four, components making up a group 
were all the same size, shape, and type of.Jcomponent and were all locate.d in 
the same general .area of the 'board) . The 20 pins on the sy/ithesizer board > 
-wero/divided. into five groups with each , group 'composed of four pins matched on 
location. Each of the four components/pins'- within each group were then, 
assigned to different resolution level s^T "The matching war done in' order to 
•reduce the variability between the test points toi-be-located in the different 
resolution levels. ''^ . ' " ■ 

A software program "'wr.itten In ) CAMIL (CompuW - Assisted/Managed 
Instructional- Language)^was developed for presentation of text and, graph-ics_ to 
t-ne students. The software prffsente^ instructional- text to- the students, 
dispUyed^ the 'graphic Tine dKawing^, displayed a flashing arrtw at the test 
point to-be- located oy the stiideht, /and- ^recorded, studejpt performance data 
■gathered during the experiment. ^'-^ second, software program, written in 
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Figure 1. Transmitter, Board of the, AN/ARC-164 
UHF Radio (component side). '. 




Figure 2. Synthesizer PC Board of the AN/ARC-164 
UHF Radio (pin sidfe).. « • 
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FORTRAN, was' developed in ord^r, to simulate the three^ display screen sizes 
(through electronic masking of a larger display screen) and the four levels of 
Resolution.' 

' The four resolution levels were simulated via a software fcoatrol 
technique which involved, the use of a coordinate checking and validation 
process. Through this process, specific pixels (dots) were selectively turned 
dn^ (stimulated) or turned off. ^ In the 280 dot? per ih.ch cpnditidh, all pixels 
'Whiiif composed the line drawing were stimulated; in the WO dots per , inch 
condition, onerhalf of the pixels were stimulated (i.e., every other pixel was 
turned oh); in the 70 dots per inch condition, one-fourth of the pixels were 
stimulated (i.e.^ 4 pixels were turned off between each stimulated pixel); 
and in the 35 dots per inch condition, one-eighth of the pixels, were 
stimulated *{i.e., 8 pixels* were turned" off between each stimulated pixel), 
the stifpulated/unstimulated pixel array for each resolution level is depicted 
in Figure 3. 
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Figure 3. Array of Stimulated PixeTs By; Resolution Level 

Jhe 36 students were randomly assigned a student - number which 
corresponded to one of the three display screen sizes. On this basis., 12^ 
students were assigned; to the 5"x5" screen size condition,; 12 studfents to the 
9"x9'', screen size cohdition* ' and 12 students to the 12"xi2" screen size 
condition. Each student "^Was tested individually. 

Students were seated approximately 2^" from the dis'pl 
^.restrictions placed on postur^Each student received 
verbary from the exp ,<"imenter.{see"Ap^endix B). Detailed 
then presented oil the display screen -(^e, Appendix C). 
locator taik trials, each student performed practice trial 
three conjecutive correctly identified test poi-nts>-^,JQie 
test poi'ntJ which were different than those used in' the~|ae 
phase 3?nd .vjiere administered at the resolution level In vfhi 

Thirty-four of the, students adhi 
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in three or four practice trials, one student required six" practice trials, 
and one student required 10 practice trials. 

All 12 students in each group then completed four sets of 15' locator task 
trials, one set for each, level of resolution. Each set of trials consisted of 
first locating and idenltifying 10 components on the actual transmitter PC 
board and then> Ipcati'ng and identifying 5 pins on the actua). syntTiesiz^r PC 
board, based uporj^fhe component/pin identified by the flashing arrow ori the 
graphic display. Thus, each set consisted of 15 trials (10 component? and 5 
pins) and e^ch student performed a total of 60 different trials acro'ss ' the 
four lev&Ts of resolution. The order of presentation for level of resolution 
was counterbalanced in order to ensure that the repeated measures were 
Indep^Hdent and to control for learning effects. 

/oue to hardware limitations and the amount of detail depicted in the 
graphic line drawings, the data lists which were. used to generate the graphic 
displays of the PC boards tended to overload the computer's refresh rate. 
This resulted in slow drawing times of the graphic PC boards (51 seconds for 
the transmitter board and 103 seconds for, the synthesizer board), and a slight 
flickering of the CRT display. The slow drawing times which occurred each 
time the display changed from one PC board to the -other (i.e., four times for 
the transmitter board and four times for the synthesizer boar'd) could not be 
averted- and were witnessed by all students. The flickering of the display, 
however, was reduced substantially .by darkening the room and permitting each 
student to adjust the intensity control on the monitor. A dimly lit table 
lamp was used at the experimental station so that student and instructor could 
see'the actual PC boards used in the locator task. Despite these alterations, 
a very slight flicker remained. Student comments related to the flicker were 
minimal. 

PERFORMANCE MEASURES 

Pesponse. accuracy (correct/incorrect) on the locator task was assessed by 
the experimenter and manually entered into the computer following each trial. 
The experimenter was an electrical engineer, knowledgeable in PC board layout 
^nd design. Response .time (in seconds) was recorded by the computer from the 
time the test point to-be-lpcated was identified by the flashing arrow until 
the student said "stop" ; and the experimenter typed "s" on t^ie keyboard. 
Response accuracy and response time data were stored by the compute** on disk 
for subsequent analysis. / y , 

'design. AND ANALYSIS 

' The experiment employed a 3x4 mixed design with three levels of screen 
size as the between-subjects factor and four levels of resolution as the 
repeated or within-su'bjects factor. Separate analyses" of variance (ANOVAs) 
were performed for each of the two PC boards and for the two dependent 
variables, response accuracy, and response time. Jhe four .separate ANOVAs mre 
performed because this method is the rnost efficacious, means for data 
interpretation and does not confound the results of the two dependent 
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variables or the differences between the PC boards. To further clarify the 
results, subsequent analyses were performed using Duncan's multiple range test 
(Brunning and Kintz, 1977) for pairwise comparisons" among the means of 
significant effects. 
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SECTION III 

~ , RESULTS ' 

RESPONSE ACCURACY . \ , 

The number of test paints correctly identified by each student for each 
coi:^dition waa converted to a percentage correct score and th^ analyses were 
performed on these percentages. " ^ 

Component' Side Pp'Board • ' - 

The ANOVA revealed no main effect for ^either screen size (means = 89.59%^ 
93.75%j and 90.42%) or resolution (means = 91.11%, 93:33%, 89^*72%, and 
90.83%), (j^>.05), suggesting that response accuracy is. not significantly 
impacted by either variable. No interaction between screen size and 
resolution was evident in the analysis, (£>.05). The means and standar|J 
deviations for the component side response accuracy data, analyzed by screen 
size and resolution, are presented in Table D-1 (Appendix 0). Table 0-2 
(Appendix 0) is the summary table for the ANOVA performed on these data. 

Pin Side PC Board ^ 

The analysis of the response accuracy data for, the- pin side PC board 
revealed a main effect for %creen size, F(2,33) = 5.41, £<.01, indicating that 
screen size significantly affected ju:curacy rates (means = ^0.83%, 95.00%, and 
98.75%). Duncan's multiple range test* 'Identified ;cignificant -response 
accuracy differences between the 5"x5" (90.83%) and 12"xJ^" (98.75%) screen 
size conditions, (£<.05). Student locator task performance was- significantly 
more accurate when the stimulus material (i.e., the graphic synthesizer board) 
was presented On the^l2"9(12" display screen than when; presented on the 5"x5** 
display screen. No other . differences between screeh size means reached 
statistical significance* *f / '"^ ^ 

. * ^ / - 

No main effect was found for resolution (means = ^2'.22%, 95.00%, 95.00%, 
and 97.22%), .suggesting that resolution did not have a significant impact on 
accuracy, nor was a screen size by resolution Interaction evident in ^ the 
analysis*, (£>*05). Table D-3 (Appendix 0) presen^ts the means and standard' 
deviations for the pin side response accuracy data, analyzed by screen size 
and resolution. Table D-4 (Appendix D) is the spimiary table for the ANOVA 
performed on, these data. / 

RESPONSE tiME ' \ . ^ 

The number of seconds taken by each student to locate each test point was/ 
recorded for all conditions. These data were then converted to scores which/ 
represented each student's average response time for locating test points if 
each condition. The analyses were performed on ^these (average) response time 
data* ' * 
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« 

Component Side PC Board " " ' , , - 

» 

The lack of a main effect for screen size (means - 5.66 seconds, 5.91 
seconds, and 5.70 seconds), (£> .05)^ suggests that response time was not 
significantly impacted by screen size. However, the analysis did reveal a 
main effect for resolution, F(3,99) = 6.91, £<.01, indipating that significant 
response time differences existed between resolution levels (means = 6.Q0 
seconds, 5.59 seconds, 5.23 seconds; and 6.21 seconds). Duncan's multiple 
range test identified . statistically significant response time differences 
between the 35 and 140 dots per^inch conditions, between the 70 and 280 dots 
per inch conditions, and betv^een the 140 and 280 dots per inch condltiohs; (£<. 
.05 in all cases). The data show that response time was shortest when the 
graphic display was presented at the WO dots per inch resolution level (5;23 
seconds) and 16ngest when presented at the 280 dots per inch resolution level 
(6.21 seconds). '• No interaction between screen size and resolution was 
revealed, . {£>.05). Table D-5 (Appendix D) presents the means and standard 
deviations for the component side response time data, analyzed 'by screen 'size 
and resolution. Table D-6 (Appendix D) is the summary table for the ANOVA 
performed' on these data. 

Pin Side PC Bo"ard 

No main effects were found for screen size (means = 6.12 seconds, 6.30 
seconds, and 5.85 seconds) or for resolution (means = 6.38 secondSy^S-. 75 . 
seconds, 6.11 seconds, and" .6.11 seconds)', (^>.05) suggesting .that Mther 
variable significantly impacted response time. No screen size by resolution 
interaction was revealed in the analysis, (£>.05). The means and standard 
deviations ftr the pin' side response time data, analyzed by screen size and 
resolution, are presented in Table D-7 (Appendix D). Table 0^8 (Appendix D) 
i? the summary table for tHe ANOVA performed on, these data. 
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SECTION IV . 
DISCUSSION 



The two dependent measures used in this study, response accuracy and 
response time, are discussed below in terms of the- two independent variables 
exefminedv scr6en size and resolution.' * 

RESPONSE ACCURACY ' ' 

Screen Size * 

Screen ^ze had an affect gn response accuracy only rwfien discriminability 
between tesr points was low. Accordiag to the data, graphic displays with 
large numbers of highly similar test points located in proximity to one 
another, such as in the pase of the pin side PC- bo,ard graphiC;, warrant larger 

\ display screens. This is ' evidenced by the significant response accuracy 
^difference between the 5"x5" and 12"xl2" screen sizes on the pin side graphic, 
>/here accuracy was almost eight percentage points higher in the 12"xl2" 
condition. When discriminability between test points is high, such as with 
the component side, PC board graphic, accuracy was not affected by screen size. 

, .Based on these findings, it appears that screen size is critical to accuracy 
only when the i(idivi dual elements of the display (i.e., test points) • are 
highly repetitious and'densely packed. These findings may be explained when 
one examines the 'information density of the component and pin side graphic 
displays.. . , • , 

The component side graphic contains a relatively small number of test 
points dispersed througfiiout the PC board. The test points vary widely in size 
and shape, and because of this diversity, several unique 1-aadmarks (cues) <are 
prevalent. These landmarks may serve as reference points which aid the 
student in "narrowing the search" down to a small group of test points from 
which final identification is ftiade. Because of the variety of shapes and 
sizes, ther| is little 'competition from surrounding components. As a *result, 
the abilfty to discrimlriate bgtween components is relatively easy. 
Consequently, locator tas];: performance is stable across ctjndi'tions and 
'accuracy scores fj^uctuate only sligl^tly. . . ^* 

In contrast to the component side* graphic, the pin side graphic is 
composed of a large number of highly similar, densely packed test points. 
Accor^ding to . Galitz - (1980)^ high Information densities contribute to 
"competition among screen components for a person's attention" (p. 108). 
This'high level of information density, coupled with a small display screen 
tends .to "squeeze" the elements of the display together, which may have 
hindered searching behavior. However, as screen size increases, compactness 
IS. reduce^, the picture is expanded, and because the display is easier to 
scan, searching for test points is facilitated. Similar explanations have 
been offered by Jones (1978) for alphanumeric displays. 
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Resolutton - . . 

Although i;*esponSe accuracy on the pin side PC board graphic improved 
sli^ghtly or .r\eraained steady as resolution "increased, none of the differences 
were statistically significant. Similarly, response accuracy between 
resolution levels, on the component side PC board failed to reach statistical 
significance: In other words, for both PC boards examined, response accuifacy 
in the lowest jresolution level (35 dots per inch') was not significantly 
different than re;sponse accuracy iri the highest resolution level {280 dots per 
Inch). This f inching is in contrast to both Gould (1968), in^wlrich 50 dots per 
inch was identified as the minimum resolution for graphics, and Stahin (1980), 
who suggests that 70 dots per inch should be the minimum resolution.. The data 
suggest that for task's such as locating test points *on PC boaijjds, level of 
■"resolution of the graphic "display has little imfract on response 'accuracy. 

RESPONSE TIME ^ ' ^ ^ ' ^ 

Screen Size 

The -lack of significant response time* differences between screen size 
conditions for both PC boards suggests that screen size neither helped nor 
hindered locator task response time. In both cases, the 9"x9" scrfeen resulted 
in '^the longest response times, hQwever, the times were statistically equal to 
those in both 'the/ 5"x5'^ and 12"xl2" screen size conditions. Thus, the results 
suggest that display screen size ,1s nAfeicriticaVto the amount ,of^ time needed 
t-o locate test points. ' • 

Resolution , " , 

The resolution main effect for the component side .graphic demonstrated 
that student response times varied significantly across resolution levels; 
this was not €r^p for the pin side graphic where response times were equal for 
all resolution levels. Despite the statistically significant differences 
between some response time* means, the differences appear to have little 
prJictical significance for maintenance ^PAs» An examination of the data shows 
that the greatest difference between the response time means was .98 seconds 
for the component side (6.21 seconos minus 5.23 seconds; seer kable D-5, 
Appendix D). In other words, students required less than one extfa second (on 
the average) to locate components in the 280 dots per Inch condition than In 
the 140 dots per. inch condition. ^ I . 

Tullis (1983) points out that an extra one second in search and retrieval 
time on each CRT frame of information accessed, V.anslated to an extra 55 
person-years needed for extracting such information (based on a qompany-wide 
yearly access rate of 344 million CRT frames of information). Such dramatic 
results, however, would likely be applicable pfimat;11y in settings with highly 
structured, repetitive jobs where tasks are highly procedural ized and where 
most pf the total task time is devoted to searching a display screen for 
.information. In this type of setting, tasks are relatively easy to perform. 
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errors are infrequent, emphasis is placed on speed, and each task is completed 
in a matter of seconds. In this case, a one second difference in search and 
retrieval time would represent a significant' proportion of total ta^sk time. 

An extra one seccmd in search and retrieval time when GPAs are used to 
assist in maintenance task performance does not appear to liave the same 
implications as those described by Tullls (1983). Maintaining complex 
equipment, unlike the tasks in a higlily procedural ized production, setting, is 
typically not highly structured, repetitive, or procedural ized, even when JPAs 
are used. The primary emphasis in piaintenance is on accuracy, that i.s, 
returning the equipment to a fully operational condition. Often, the entire 
mc^intenanQe task requires several hours to complete. 

When performing maintenance tasks^ technicians must, search for and 
retrieve technical inforrnation (from either paper media such as technical 
manuals or paper JPAs, microfilm/micf^of iche, or electronic disp?ay media) in 
order to make the repair. Typically, the time required to^ locate the critical 
information is quite short. (In t;.he present study, the overall mean response 
time was 5.76 iseconds for the component side and 6^09 seconds for the pin 
side). The bulk of maintenance task time is usually devoted to^ applying, the 
"retrieved" information to the piece of equipment under repair and to actually 
making the repair. In other words, the information needed (e.g.,* identify.ing 
the test points to be probed) can ba obtained rapidly, but implementing that 
irfformation (actuaTly probing the test points and determining tolerance 
levels) and then making the repair (removing the faulty module/compont. ) and 
replacing it) account for the majority of the maintenance task time. Thus, 
one extra second of search and* retrieval time represents a very small 
proportion of total task time. - . ' 

When examined in the broader context of an overall maintenance tasH which 
may require .several hours to complete, the small time differences which were 
evident across resolution levels are put into perspective^ Even when a large 
number of test points must be identified, the cuifnulative effect of suth^me 
differences is still relatively small. Therefore, it -appears that the impact 
of a ♦one second time reduction in locator task performance is negllgable, 
despite the statistically significant differences. ^ ' ' ^ ^ 
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" SECTION V V ' • . 

■. .■> 

' CONCLUSIONS 

The intent of this re'search was to provide design guidance in supporf of 
automated JPA development.^ Although the research was tailored specifically to 
JPA design issues related to maintenance functions, the results may apply to 
other situations in, which CRT-based -graphics are ^used. Based upon the 
findings^ the follojjing conclusions are drawn: 

1. The 5"x5" display should not be used for graphics with-^'^high 
information , ^density and. low Siscriminability . among elements within the 
graphtc. This, size should ' suffice, however, for displays with high 
discriminability among the elements. 

2. Since th^ 9"x9" and 12"xl2" display sizes resulted in statisticailly 
equal response accuracies for both the pin side and component side graphics, 
either size can be used to produce best overall accuracy. 'Final size 
selection should be, based on other factors (e.g., cost, portability, devite 
size,- etc.).. . ' , - 

3. Display size had no significant impact on the amount cf required 
to -perform the locator task. . ^ 

4. Level of resolution had no practical impact on either response 
accuracy or response time. Design decisions pertaining to the resolution 
required should, ^therefore, be based on factors other than accuracy rates and 
response times (e.g., monitor r"equir*ements). ^ ^ 

5. Further research is warranted in order .to identify optimum visual 

display parameters for electronic JPAs. Suggested research ar*eas include: 
♦ 

a. - Level of Retail - When portability and size are critical design 
issues, smaller dispUys may be required, yet the data suggest that the 5Vx5" 
display may* hinder response accuracy for graphig ^^di splays with high 
information density and low discriminability. Information density can be 
reduced and, discriminability enhanced by varying the amount of detail in the 
gl^phic line drawings (i.e,, by ©iliminating .ngn-critical segments of the 
graphic display). The impact of varying the amount of detail is unknown. 

b. Effect on.overarll maintenance task performance - .The study' 
focused on, one small step of the entire maintenance process:' locating PC 
board * test points. Additional research should focus on^ tasks more 
representative of the domain in which automated JPAs will be used: fault 
isolation, remove and replace, disassembly/assembly, etc. The results of ^uch 
analyses would provide stronger evidence of the impact of critical legibility 
variablfts on overall maintenance task performance when electronic display 
media ^e used. 
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(' 

c. Alternative display media - In the future, electronic JPAs may 
be expected to 'be used in field applications (outdoors). Electronic delivery 
media may make use of different display technologies (e.g., light emitting 
diodes (LED-), electroluminescent panels, plasma panels, liquid crystal, etcj;. 
These media may be better suited for displaying technical information ,mder 

V certain env.ironmental conditions. Also, critical legibility factor? should be 
vex>am"ined across types of. display media to determine the impact on task 
^ performance in various" environments. - - 

d. JPA devices for' training - The potential application of JPA 
devic^ to serve a training function '(in addition to the aiding function) has 
been largely untapped.' The utility of JPA devices to meet training needs 
should^e determined through systematic investigation. , ', . 
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APPENDIX A 
SUMMARY OF PAST RESEARCH 
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TABLE A-1. Visual Display Parameters for Elfictronic, 
Display Media - A Summary of Past Research 



T^EFERENCES 




Chroiuatidty 



Coding 



Contrast Ratio 



Direction of 
Contrast 

Dot Matrix Size 
(per character) 



Dot Shape and 
Spa£ing 



Upper and lower case are recommended for continuous/ 
text. Descenders on lower case letters should axtehd 
beiow^the line. (Note: most research has been based 
on hardcopy text).. 



The blue end of the spectrum should be avoided fqn 
monochromattc displays. The center of the spectri^m 
is easiest to see under normal viewing conditions/but 
the red end of the spectrum is easiest to see undp 
high ambient illumination. 

NumericaT-j color, blink, brightness, underline] 
reverse video codes can be used. Numerical cot 
may be best for identification tasks. 



A minimum of 10; 1 is needed with higher leyels /pre- 
ferred when ambient illumination (background lighting) 
is high. Inclusion of a contrast control is 
preferred.^ 

Either light-on-dark or dark-on-light is accebtable. 

' f 

A 5x7 matrix ii the minimum acceptable. A 7x9 or 
larger matrix is preferred, particularly where 
display qualtty is impaired. . i 

Round dots should be used with a minimum active area 
of 30 percent. 



Vartebedian, 1971b; Cakir et 
al; 1980; Craig, 1980; 
Campbell et al.,- 1981. 

Ri-zy, 1967; Wald,. 1967; Gould,. 
1969; Snowberg, 1971; Alexander 
et al., 1974; Ellis et al., ' 
1975; Tyte-et at., 1975; Krebs 
et al., 1978; Sherr, 1979; - 
Shurtleff,, 1980. 

Christner & Ra^, 1961; Hitt, 
1961; Semple, 1971; Christ, ^ 
1975; Christ, r977;JKrebs et/ . 
at., 1978; Sherr, 1979; C^k^'r - 
et aU, 1980; Tullis, 1981/ 

Crook et al . , 195i;^Howe;i'l & , 
Kraft, 19.59; Cafel, 190; 
Snyder & Maddox, 1978^ Sherr, 
1979;. Craig, 1980; Shurtleff, 
1580. ' , ■ / 

McLean, 1965. 



Shurtleff, 19?0a and b; 
Vartebedian/1971; Scanlan 
and Care! ,4976. 

Vartebedian , 1971a-; Vandervol k 
et al./1975i Stein, im- 
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PARAMETER 



RECOMMENDATIONS 



REFERENCES 



Font of Characters . 



45. 
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Flicker 



Glare and 
Relections 

Horizontal Symbol 
Spacing 



Luminance 



Resolution 



Scrolling 

Stroke vs. Dot 
Generated Symbols 



Most popular fonts (e.g., Lincoln/MITRE, NAMEL, 
Leroy) are acceptable." Serifs, slanted letters, 
and variable stroke widths should be avoided. \ 
(Note: Most recommendations for CRT fonts have 
been based on extrapolation from non-CRT research). 



The persistance of the particular phosphor used in 
, the display device should be taken into account when 
determining critical fusion frequency (CFF). 
Generally speaking, a refresh rate of 50-60 Hz is 
acceptable.. 

Matte screens are Tecommended. Filters may be 
needed under poor viewing conditions. 

.Space between symbols should be 25 percent of sym- 
bol height. Under optimum viewing conditions, 
spacing as close as 10 to 15 percent Of symbol 
height can- be used. Off-axis viewing angles which 
exceed 45 degrees require 25 to 50 percent spacing. 

Minimum requirement is 34 to 50 nits (candelas per 
square Ineter). Higher values are preferred,, - 
particularly when ambient illumination (background 
lighting) is high, ^n adjustment control is 
preferred. 

The higher the resolution, the better. Maximum 
usatple resolution occurs when display element 
size subtends one minute of arc. Fifty lines per 
inch is the minimum for graphics. 

•If used, scrolling should be smooth. ',• 

Either stroke or dot generated symbols are 
acceptable. 



Brown, 1953; Ketchell .& jenny. 
1968; Shurtleff, 1970; Semple •■ 
et al . , 1971; Vartebediaa, 
1971; Vandervolk et al . , 1975; 
Riley & Barbato, 1978; 
Shurtleff, 1980". 



Gould, 1968; 
Cakir et al . 



Sherr, 
1980. 



1979; 



Hultgreen & Knave, 1974; 
Cakir et al., 1980. • 

Crook et al . , 1954a and b; 
Shurtleff & Alexander, 1972; 
Shurtleff, 1980; Kolers et 
al., 1981; Sherr, 1982. 



Faulkner & Murphy, 1973; 
Sherr, 1979; Cakir" et al . , 
1980; Shurtleff, 1980; 
Campbell et al., 1981. " 

Gould, 1968; Biberman, 1973; 
Sherr, 1979; Craig, 1980. , 



Kolers et al . , 1981. 

Shurtleff, 1974; O'.Donnel & 
.Gomer, 1976; Schnessler, 1976;- 
Vandervolk, 1976;- Sherr, 1979. 
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PARAMETER 



RECOMMENDATIONS 



REFERENCES 



Stroke Width 



Symbol Height 



Symbol Resolution 



Symbol Width-to- 
Height Ratio 



Vertical Line 
Spacing 

Viewing Angle 



Visual Fatigue 



Stroke width should be 12 to 20 percent of symbol 
height with the wider end of the range generally 
better;'. 



Symbol height should be in the range of 16 to 22 
minutes of arc. " 



Ten to 12 scan lines per symbol height are needed 
for CRT displays. 



Symbol width, should be in the range of 70 to 80 
percent of symbol height. 



Space between rows of text should be equal to 50 
percent of symbol height. 



Viewing angle should not exceed 19 degrees. This 
should not present a problem as the user should be 
able to move the display or change viewing angle. 

Further research is needed on the effects of using 
electronic information delivery on visual fatigue 
of the user. Fatigue may be partially due to work 
station layout. 



Crook et-al., L954a and b; 
Sherr, 1979; Cakir et at., 
1980, Craig, 1980; Shurtleff, 
1980. . ^ 

Woodson & Conover, 1964; 
Ketchel &" Jenny, 1968; Sherr» 
1979; Cakir et al.; 1980;. 
.Shurtleff, 1980; Campbell et 
al.,- 1981; Sherr, 1982. 

Shurtleff, 1966; Gquld, 1968; 
Gakir et al., 1980; Craig, 
1980; Shurtleff, 1980; 
Campbell et al., 1981. 

Semple et al., 197-1; Buckler, 
1977; Sherr, 1979; Cakir et 
al., 1980, Shurtleff, 198~0. 

Streeter et al . , 1978; Cakir 
et al., 1980; Craig. '1980; 
KolerS, 1981. 

Seibert et al., 1959; 
Shurtleff, 1980. 



Hultgreen & Knave, 1974"; 
Dainbff et al., 1981; Matula, 
1981; Mourant et al., 1981. 
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APPEND|I B 
VERBAL INSTRUCTI^fi^S TO' STUDENTS 
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Good^fTjOrning (afternoon). My name is Erich Pearson and I will be the 
instructor if or this exercise. You have been selected to participate in a 
study that 'wVl help tKe Ail" Force determine the best way to show maintenance 
information on a computer screen. The specific instructions will be presented 
to you on the computer screen, so'I will not go over them here. The entire 
exercise should take about an hour and a half. Before we get started, you 
will have, a few practice trials so that if you are confused and have any 
Questions, you can ask them during practice. So, if you're ready, we'll 
begin.. 
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APPENDIX C 
STUDENT INSTRUCTIONS PRESENTED ON CRT 
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FRAME ONE: 



INSTRUCTIONS 



You are part of a study to find the best way to show tnai ntenarfce 
information on a computer screen. . In front of yoi/ is: • - 

1* A computer screen ^ 1 

2". 'A section from a radio , • " , . 

3. A pencil to use as a pointer - - 

' - . ■■■ > 

The person next to you is the instructor running the study. Tell him when, 
you have finished reading. ■ " 



FRAME TWO : 

The computer screen will show you a drawl ng-jof a ;^afeion^6f a -radio. 
The shapes, on the drawing are the same as the shapes of the parts on the ' 
radio section. The instructor will sihow you how to hold the section of the 
radio so that the parts on the drawing will match those on the^radio. He 
will then -show you how to find. one of. the parts. ,Tell him when you have 
finished reading. " . * . ' . 

FRAME THREE ; * , , . - . - 

You will be allowed 1|) pracjtice some before the scoriAg^ starts. When 
you tell the instructor that you are ready, 'one of the parts on the drawing 
will have an arrow dr^wn to it.' You must: . f " 

1. LOCATE THE PART Ofi THE RADip . • 

2. POINT TO THE PART WITH THE POINTER AND SAY 'STOP' - ^ 

3. KEEP THE POINTER. ON THE PAI^T UNTIL- THE INSTRUCTOR TELLS YOU THAT YOU 
• MAY MOVE IT ' ^ ' 



FRAME FOUR:- . " ,o . , ; ' 

You will be scored on how fast you find the'parts and on whether you 
find the right parts. Work fast but- bj?, sure 'you find the right part. If 
you have any questions, please ask the instructor nov^. 
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fRAME rvFIVE; {Presented after the first ten trials in each set) 



The instructor will now give you another section of the radio^ The new 
$,ection has one side removed to show a board covered w-ith little silver 
connections. The instructor will show you how t0 hold it so that it matches, 
thd drawing Sh the screen and how to find one of the connections* Vou are, to- 
point to the connections on the radio section just as you did the radio 
parts, » Remember, you are being §cored on speed and accuracy. If you liave, . 
amy questions/please ask the instructor no^y. Otherwise, ask your instructor 
•for ^Ke new radio board. ' • , • 
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APPENDIX D 



MEANS. STANDARD DEVIATIONS AND SUMMARY TABLES 
FOR ^RCOTiSE ACCURACY AND RESPONSE TIME DATA 
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TABLE D-1 

MEANS AfID STANDARD DEVIATIONS FOR RESPONSE ACCURACY DATA 
ANALYZED BY SCREEN SIZE AND RESOLUTION 
' (COMPONENT SIDE) 



SCREEN SIZE 

. ■ I 



5x5 



M 
SD 



35 



9.96 



RESOLUTION 



70 



140 



28^ 



92.50 
6.22 



86. 6S 
7<78 



90.00 
7.39 



Row Means 
(n=12) 



89.59 
7.98 



9x9 



M 
SD 



94.17 
7.93 



.96.67 
4.92 



91.67 
-7.18 



92.50 . 
11.38 



93.75 
8.15 



12x12 



M 
SD 



Column Means'' M 
{N=35)'- SD 



'90.00. 
8.53 



91.11 
8.87 



90.83 
' 5.15 



93*33 
5.86 



90.83 
7.93 



89.72 
7.74 



90.00 
12.06 



90.83 
10.25 



90.42 
8.49 



Note. The values represent mean percent correct scores. 
^Average of the 4 resolution means. 
''Average of the 3 screen size means. 

■ I 
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TABLE D-2 ^ 
ANALYSIS OF VARIANCE SUMMARY TABLE FOR RESPONSE ACCURACY DATA 

- (-COMPONENT SIDE) 



SOURCE 


df 


SS 


>1S 


F 


. Between Subjects 
Screen Size 
» Error 


35 
2 

33 • 


4625.00 
466.67 
4158.33 


233.33 - 
126.01 


1.85 


Within Subjects 
Resolutign 

Screen Size x Resolution 
Error 


108 
3 
6 

99 


5350. J30 
'247.22 
144.44 

4958.33 


, 82.41 - 
24.07 
50.08 


1.65 
0.48 
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TABLE D-3 / / 
MEANS AND STANDARD DEVIATIONS FOR RESPONSE- ACCURACY! DATA 
ANAlIYZED BY^SCREEN size m RESOLUTION 
(PIN SIDE 



SCREEN SIZE 



12x12 



M 
SD 



Column Means^ M 
SD 



.{N=36) 



R^OLUTION 



96.67 100.00 
7.7-9 0.00 



92,22 
16.05 



95.00 
8.78 



100.00 
0.00 



95.00 
11.08. 



97.22 
7.01 



Row Means 
(n=12) 




.98.75 
'4.89- 



Notfr. The values represent mean percent correct scores. 



^Average of theAresolution means. 
''Average of ^e 3 screen size means. 
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TABLE D-4 

ANALYSIS OF- VARIANCE SUMMARY TABLE FOR i^ESPONSE ACCURACY DATA 

(PIN SIDE) . . 



SOURCE 


df 


SS 


MS 


F . 


Between Subjects 
Screen Size 
Error . 


35 
2 

33 


6097.22 ' 

1505.56 

4591.67 


752.78 
139.14 


5.41* 


Within^ubjects 
Resolution 

Screen Size x Resolution 
Error 


108 
3 
6 

99 


12,100.00 
452.7© 
405.56 

11,241.67 


150.93 
67.59 
113.55 


1.33 
0.60 

• 
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- ^ TABLE D-.5 

MEANS And standard deviations for response time data 

ANALYZED BY SCREEN SIZE AND RESOLUTION 
(COMPONENT SIDE) 



SCREEN SIZE RESOLUTION 







35 

.- 


70 


140 


280 . 


Row Means^ 
(.n=12) 


5x5 


M 


5.95 


5.43 


5.28 


5.99 - 


5.66 . 


0 


SD 


1.46 


1.35 


0.95 


1.58 


1.35 


'9x9 


N 


6.31 


5.37 


5.48 


6.47 


5.91 


* 


-■1 


2.59 


1.30- 


1.26 . 


1.85 


1.84' 


12x12 


M ' 


i 

5.73 


- *5.97 


4.93 


6.17 


5.70 


/ ■ 


SD- 


1.32 


1.39 


0.95 


1.96 


1.48 












Column Means'' 


M 


-6.00 


5.59 


5.23 .' 


6.21 




-(N=36) ^ 


SD 


i.84 


1.33. 


. 1.06 


1.77 





Nate . The va^lues represent mean response times in seconds. 
Average, of the 4 resoTution means. 
'^'Iverage of the 3 screen size means. 




- - if 



i 



. TABLE D-6 

ANALYSIS OF VARIANCE SUMMARY TABLE FOR RESPONSE TIME DATA 

(COMPONENT SIDE) 



SOURCE 


df 


SS 


MS 


F 


Between Subjects 
Screen Size 
trror | 


35 
2 


225.36 
1.61 

CCO./O 


0.80 • 
o./o 


.0.19 


Wtthin Subjects 
Resolution 

Scpeeh Size x Resolution 
- Error 


108 
3 
6 
99 


1^4.08 
20.41 

^ 6.21 
97.46 


6.80 
1.03 
0.98 . 


6.91* 

1.05 


*p<.01 




* 







37 



47 



TABLE D-7. 

MEANS AND STANDARD DEVIATIONS FOR RESPONSE TIME OATA 
ANALYZED BY SCREEN SIZE AND RESOLUTION 
(PIN SIDE-) 



SCREEN SIZE RESOLUTION 



- 

• 




35 


70 


140 


280 


Row Means ^ 
(n=l-2) 


5x5 


M 


6.90 


5.60 


6.12 


5.85 


6.12 




SD 


2.26 


- 1.43 


1.83 


1.91 


1.89 


9x9 


M 


6.35 


6.32 


6.18 


6.35 


6.30 


J 


SD 


1.79 


2.65. 


2.76 


1.40 


2.15 


12x12 ^ 


M 


5.90 


5.33 


6.03 


6.13 


5.85 




SD 


1.47 


1.37 


' 1.53 


1.63 


1.49 


Column Means'^ 


M 


6.38 


5.75 


6.U 


6.11 




(N=36) 


SD 


1.86 


i.po 


2.04 


1.63 . 





/ - ' 

/ 

Note. The values represent mean response times in seconds. 
^Average of the 4 resolution means. 
'Average of the 3 screen size means. 
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TAB.LE D-8 * 

ANALYSIS' OF VARIANCE SUMr4ARY TABLE FOR RESPONSE flMI DATA 

(PIN SIDE) 



SOURCE 



df 



Between Subjects ' 
Screen Size 
Error 



35 
2 

33 



Within Subjects ' 108 

Resolution 3 
Screen Size x ReSo-lution 6 
Error f , 99 




r 



ss 



MS 



288.90 
4.92 
283.99 

167.96 
7.29 
8.96 , 

151.71 



2.46 
8.61 



2.43 
1.49 
1.53 



0.29 



1,59 
0.97 
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